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ABSTRACT 

The first 2 of the 11 publications reviewed in this 
annotated bibliography recommend the involvement of teachers in the 
evaluation of their colleagues. Subsequent reports include the 
following points: (1) those who are likely to benefit from an 
assessment are the competent instructors who know their subject well; 

(2) a discrepancy exists between state-of-the-art and actual teacher 
evaluation practices in the nation's 100 largest school districts; 

(3) effective teacher evaluation entails qualitative judgments; and 

(4) the two common flaws in teacher evaluation instruments are 
instructional undervaluing and vagueness. Additional publications 
reviewed describe evaluation strategies that incorporate assessment 
center exercises and extensive field observation, feature six diverse 
models aimed at evaluating teachers' ability to think and improve, 
propose a single system to encompass both formative and summative 
evaluations, and provide an overview of rece*;t research on and 
discussion of teacher evaluation. (KM) 
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Teacher Evaluation 



1 



Ashbaugh, Carl R., and Katherine L. Kasten. "Shou Id 
Teachers Be Involved in Teacher Appraisal''" NASSP 
Bulletin 71 , 500 (September 1 987)- 50-53 E| 359 
331. 



Ashbaugh and Kasten make a strong argument for involving 
leachers in the evaluation of their colleagues. The authors turn first 
to administrative theory to support their position The zone-of- 
acceptance concept suggests thai subordinates should participate 
in decisions that are important to them if they bring sufficient 
expertise to the process. 

Not all teachers, however, are competent evaluators Indeed, 
frustration often (xrcurs when interested teachers with low assess- 
ment skills are included in the evaluation process. 

The authors assert that such teachers should not necessanly be 
^-^yrluded from evaluating. "There are some situations in which 
perceived relevance is so pervasive and sostrong that involvement 
must be ensured through the development of expert is - " Teac hers 
should be trained so that their skills in teacher evaluculon ectual 
their interest and stake in it 

Teachers should participate in all aspects of asr.essment, includ- 
ing summative judgments After all, the authors conclude, "one 
classic distinction of a profession is that members moniK:r the 
performance of their peers " 



2 The Capital Area School Development Association 
and the Evalu^^'^n Consortium, School of Educa- 
tion!, State Univ«;rsity of New York at Albany; and 
theCreaterCapital Region TeacherCenter. 4 View 
from the Inside- Report of the Select Sem/na/ on 
Te^icher Ev^iiuaticr, Abany, New Yo>k. Authors, 
lannary 1986 IGpa^es. ED 29 1 130. 

In 1985 nne distinguished teache-s and nine adminisirators 
from the Albany, New \ork, area met for five days to discuss 
teacher evaluation Thii, tyookiet summarizes t!'e?«' conclusfons. 

The participants agreed that tea'.heis shou'H have more rcntrol 
over evaluation i. Districts should institute seminars on evaluation 
led by teachers and form c ad res u( teachers who regu la rl y ev a luate 
They should be more concerned with tearher development than 
with teacher accountabiiity Peer a*^sessments shou'd be trequent. 



though the results of those reviews should not be part of a teacher's 
official record. 

The conference participants also wished to extend evaluation 
beyond simple classroom observation School distncts must also 
be sensitive to the different needs of neophyte and expenenced 
teachers. The former should have many evaluations and ample 
release time to observe and confer with more experienced teach- 
ers Tenured instructors are best served by informal, self-generated 
assessments. 



3 Duke, Daniel L., and Richard j. Stiggins. Teacher 
Ewiliuition Five Keys to Growth. Washington, D.C* 
American Association of School Administrators, 
National Association of Elementary School Princi- 
pals, National Association of Secondary School 
Principals, and National Education Association, 
1986. 56 pages ED 275 069 

The authors conducted a case study of thirty teachers who have 
benefited trom positive evaluations to identify salient aspects of 
effective teacher assessments 

They assert that the teacher is the most critical component to a 
successful evaluation. Those most likely to benefit from assess- 
ment are competent instructors who know their subject well. They 
are also open to suggestions, willing to change, and set high 
personal goah The skilled supervisor must stnve to create a safe 
clinvite for improvement tor teachers of all types 

Effective evaluators earn teachers' respect by knowing the 
instructors' subject jr jas and students. Supervisors mi 'st model the 
traits they value. A prmcipal who wants a staff open to criticism 
should invite feedback on her or his own work. 

The sort of data usc^d in an evaluation depends largely on its 
purpose Assessments ciesigned to measure pertormance against 
'nin'mum criteria must be rigorousiy uniform and le[;a!ly defen- 
* ib^'j. ^Evaluations intended to promote staff development should 
be much more flexible and descriptive, perhaps including grading 
practices comments to and iiotn ...tudents, and peer assessments. 
Tne most detailed a ad ac c urate evaluationsc an Kickf.re, however, 
if supervisors do not convey »hem in a sensitive and respectful 
manner. 
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Ellett, Chad D., and joAnne S. Garland. ' Teacher 
Evaluation Practices in Our Largest School Districts 
Are They Measuring up to 'State-of-the-Art' Sys- 
tems^" Unpublished paper, August 1986. 3bpages 
ED 294 316 



Ellett and Garland present a study that reveals a distressing gap 
between state-of-the-art evaluation practices and actual teacher 
assessment in the nation's one hundred largest school districts. 

Slightly more than one half of the eighty districts that responded 
to the authors' questionnaires useevaluation policies that are over 
five years old. They most frequently use evaluations to help or 
dismiss ineffective teachers. Indeed, few provide effective teachers 
with many opportunities for professional development 

The districts rely very heavily on supervisors for evaluation. 
Only 10 percent of them use teachers, compared to 100 percent 
that use principals and 93 percent that use assistant principals 
Only two-thirds require more than two days of training in evalu- 
ation, and a substantial minority use neither video nor live obser- 
vation. 

Evaluation methods alsotend to be very traditional Virtually all 
the districts use direct observation. Only 31 peicent use self- 
evaluations, 1 1 percent use peer ratings, and 4 percent use student 
ratings. Nontenured teachers usually receive two to three evalu- 
ations per year; tenured teachers, one to two. Nearly three-quarters 
use a standard document to evaluate Most of the thirty such 
documents submitted are summative and categorical in natu^'e and 
do not encourage formative or written assessments 

Only 8 percent of the respondents said that their evaluation 
practices were inadequate. The authors see little progress since a 
similar survey Jone m 1 979. They recommend better communi- 
cation between the school districts and the researchers, trainers, 
and others who have improved teacher evaluation during the past 
decade 



5 Herrmann, Be!h Ann. "Effective Teacher Evalu- 
ation* A Quantitative and Qualitative Process." 
NASSP Bulletin 71 , 503 {December 1 987): 23-30 E| 
364 768, 

Effective teacher evaluation entails qualitative fudgments, not 
just recording and coding observable behaviors, argues Herrmann 
She supports her thesis by presenting a case in which evaluation 
failed to predict teacher effectiveness. 

The experiment featured two math teachers who receivf^d iden- 
tical training in how to apply the direct explanation model of 
instruction to a small group of students having trouble witK Su>rv 
problems. Evaluators awarded both teachers high quantitative 
scores. Yet postobservation interviews with the students revealed 
stark difference^ in how effectively the two teachers conveyed their 
material. 

The more succt-ssful teacher began by specifically stating the 
lesson's goal. She used a particular illustration to exhibit the s'<iirs 
usefulness, one that the students knew they would encounter only 
a few years later. The other teacher spoke of the lesson's relevance 
in much more general terms. 

The effective teacher used concrete, direct questions and re- 
sponses whereas the olher tended to be vague and abstract. The 
former conceptualized each teaching strategy and conveyed the 
strategies in a way her students could understand. The latter used 
the same strategies in un inflexible step-by-step procedure De- 
spite these subile but profound distinctions between the two 
approaches, the quantitative evaluation instrument could not 
detect the differences in the two teachers' effectiveness, 

effective evaluators, Herrmann concludes, must do more than 



passively code behav or. They must understand and recognize the 
nuanc es ot effective teaching. 



e Peterson, Donovan. "De/elopmg Teacher Evalu- 
ation Systems with Potential for Increasing Student 
Performance,' Educational Reseatch Quarterly 1 0, 
2 (1985-86): 39-46, E| 336 884, 

Peterson detects two common flaws in teacher eval uation instru- 
ments* they undervalue instruction and they are vague. Such tools 
provide poor measures ot teaching effectiveness 

A sampling of sixteen Florida school districts revealed that only 
5 to 40 percent of the evaluation instruments' content focused on 
teaching "In many of these districts," notes Peterson, "teacher 
background, appearance, interpersonal relations and care of ma- 
tenals and classroom accounted for well over half as much as did 
instruction in the teachers' evaluation," Yet teachers' classroom 
performance is second only to students' prior knowledge in pre- 
dicting student performance 

The evaluation tools also suffered from imprecision. Many 
contained words iike ' organization" and "praise" without defining 
them. Praise, after all, is not always effective, and evaluators need 
to stipulate what sort of praise they observe. 

Much care is required to create an effective evaluation instru- 
ment Those who write them should be experienced teachers with 
strong conceptual skills The instrument should be carefully tested 
by seeing if several skilled coders agree in their observations and 
by seeing if the instrument accurately predicts student achieve- 
ment. 



7 



Peterson, Kenneth D; Donna Dehle; and William 
Watkins. "Evaluation That Accommodates Minority 
Teacher Contributions " Urban Education 23, 2 
duly 1988), 133-49. E| 378 333, 



The authors argue a clear thesis, "Current teacher evaluation 
proi edures do not distinguish contributions made to minority 
students, espe"ia!Iy by minority teacheis," 

Conventional rating or checklist forms fail to addressmany of the 
qualities needed to teach minorities. The authors present an 
assessment system that has beer much more effective, a multiple 
and varied evaluation system used by two Utah school districts. 
This system allows teachers to choose the criteria by which they 
will be evaluated. Materials might include studem reports, parent 
surveys, teacfier tests, documentation of professionalisn., student 
ach.evempnt data, systematic observations, and administrator re- 
ports The teachers inspect these data before submitting them to a 
panel of teachers, administrators, and parents who then decide if 
the applicant should be an associate teacher. 

This varied evaluation system well serves teachers of minority 
students because it treats seriously the varied skills such teachers 
must have. For example, teachers can be assessed according to 
their incorporation of minority language and culture in their 
classrooms or by community participation 



aShulman, Lee S. "Assessment for Teaching: An 
Initiative for the Profession." Phi Delta Kappan69A 
(Septc^mber 1987): 38-44. E| 359 287, 

The author, director of the Teacher Assessment Project, here 
describes several evaluation strategies that he is proposing to the 
National Board of Professional Teaching Standards. He empha- 
sizes the need to use a broad array of evidence to evaluate teachers. 



ERIC 



Ideally, Shulman says, evaluations should incorporateexefcises 
at an assessment center and extensive field observation. The 
centers would provide teaching simulations. A candidate might 
bring a vtdeotapeof a successful lesson, show ittoexaminers* and 
discuss how she or he formulated and executed it. The field obser- 
vations would be supervised by a mentor who both evaluated and 
supported the candidate. The observations would generate a 
portfolio with material like lesson plans, student work with teacher 
comments, videoupes of teaching, observers' notes, and com- 
ments by the mentor teacher. 

Th is eclectic style of evaluation has several advantages^ says the 
author. It enables teachers to demonstrate their competence 
actively rather than by passively taking an exam. It suggests how 
diverse teaching is, and it conve/$ that teachers must be sensitive 
to a broad array of students and subjects. A flexible style of 
evaluation is most likely to foster the sort of flexibility a successful 
teacher must possess, particularly since many teacher education 
programs design curricula with an eye toward preparing their 
students for evaluation instruments. 

Thp author advocates assessments that will, "in the very process 
of being implemented through super\^ed residencies ir.theschools, 
introduce ncv. forms of mcnlorship, collaboration, and collegia!- 
ily" 
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eSUnley,SarahJ^andW.|ame$Popham,Ed$. Teacher 
Evaluation: Six Prescription: for Success. Alexan- 
dria, Virginia: Association for Supervision and Cur* 
riculum Development, 173 pages. ED 299 
681 

This book features six diverse teacher assessnwnt models. The 
firsi chapter treats evaluation as a means lo improve teaching. 
Thomas L. McCreal recommends establishing instructional advi- 
sory groups composed of respected teachers and a board member 
and suggests that teachers and supervisors cooperatively set teach- 
ers' goals. He opposes rating scales because they lack accuracy, 
turn criteria into rules, and force often u<e!oss and destructive 
comparisons between teachers. 

Madeline Hunter follows by describing an ambitious e valuators' 
(reining program followed by extensive staff evaluations. She 
argues that supervisors, not teachers, should evaluate because they 
are in the best position to assess teachers objectively, particularly 
in the long run. 

W. lames Popham, on the other hand, is concerned that one ad- 
ministrator .lot conduct both formative and summative evalu- 
ations. Formative evaluations are for helping teachers to improve, 
nnd teachers will not utilize tliem folly if the informal a^scssrrcnls 
are later used in summative judgnit-nts of the teacher. Formative 
es^aluations should simply focus on "the extent to which pupils ^.e 
prospering under a teacher's direction,* not on the use of accepted 
instructional principles. Summative evaluations are more format. 
Three trained and certtfied evaluators should pass judgment on a 
teacher's competence, and they should use many sources as 
evidence. 

In chapter 4 Richard Manatt outlines a three-year plan for 
effective evaluation. He pays particular attention to planning. 
Schools must carefully esublish performance standards, define 
what they mean by competence, and create an evaluation method 
free from bias. 

Michael Striven follows by proposing a dutie$4>ased approach 
to evaluation: establish what teachers are hired to do and discern 
whether they are doing it Extensive remediation may be inappfo- 
priatebecaiM replacing incompetent teachers is often cheaper, in 
making negative assessments administrates should concentrate 
on identifying and documenting any weaknem$r not on discenv 
ing reasons for or solutions to the deficiencies. 

The book conck'des on a ^'isionary note. Arthur L. Cosu, Robert 
J. Carmslon, and Linda Lambert assert that 'if the work of leaching 
is thinxing, then the evaluation of teachir^ is the evaluation of 
thinking.* Teachers, thea should not s^'mply be evaluated on what 
they know and do. Their ability to improve, change, and think must 
also be addressed. The authors would analyze and grade how 
teachers manifest these qualities in their scliools and their profes- 
sion, not just their classrooms. 



Stretfer, Philip A. Teacher Evaluation Systems: A 
Review of Critical Issues and the Current State of the 
Art Andover, Massachusetts: The Regional Labora- 
tory for Educational Improvement of the Northeast 
and Islands, August 1987. 1 S pages. EO 295 336. 

Streifer proposes a single system to encompass both formative 
and summative evaluations. He is largely concerned, however, 
with ensuringthatteachers meet well-definedtnlnimum standards. 

His program hai four components. Establishing consistent 
policies and procedures is the critical first step. Teachers, after all, 
will not support an evaluation system unless they are convinced 
that it is uniform and fair. Districts ihoufd then research the lists of 
teaching criteria created by the nation's most progrc-ssive states and 
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districts when formulating their own set of teacher evaluation 
criteria. 

Selecting appropriate performance standards is the third compo- 
nent. Streifer recommends using descriptor statements rather than 
rating scales. Observers judge if a teacher is accomplishing par- 
ticular skills that are phrased i'l behavioral language. Under the 
category of discipline, for example, a teacher is judced on eight 
descriptors, such as *The teacher calls attention to desirable 
behaviors.* Teachers must demonstratecompetence in a predeter- 
mined number of these descriptors. 

The system depends on adequate training, its fourth component. 
Principals must know what effective teaching consists of, be skilled 
classroom observers, and be able to effectively convey their 
insights to teachers. Streifer includes a self-aSsessment checklist so 
administrators can gauge theefftctiveness of theircurrent teacher- 
evalurtion practices. 
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Weber, James R. Teacher Evaluation as a Strategy 
for Improving Instruction: Synthesis of Literature. 
Eugene, Oregon: ERIC Clearinghouse on Educa- 
tional Management, University of Oregon, 1987. 
(Prepared for North Central Regional Educational 
Laboratory.) 65 pages. ED 287 213. 

Weber gives an overview of recent research on and discussion 
of teacher evaluation. He is, as his title implies, more concerned 
with formative than summative assessment. 



Summative evaluations are the most common type because the 
law often requires them and because they are relatively simple and 
brief. But they have serious limitations. "Would a district want to 
promote a teacher to master status,'' asks Weber, *on the basis of 
only minimum standards?'' 

Peer evaluation tends to encourage Instructional improvements 
because it can foster collegiality. Indeed, reciprocity and respect 
benvoen instructor and evaluator are essential for productive as- 
sessment. Evaluators, then, must be sensitive enough to communi- 
cate in a fair, nonthreatening manner and knowledgeable enough 
to command teachers' respect. Districts could include more teach- 
ers in the evaluation pro<!lss by giving them release time and by 
involving teacher organizations indesigning and overseeingevalu- 
ation procedures. 

A variety of sources should be utilized in evaluations. Written 
assessments that describe teacher:' performance are more likely to 
change behavior than are fill-in-the-blank forms. Other sources 
often found to be helpful include nonsummative peer evaluations, 
student assessments of the classroom environment, and self-evalu- 
ations. The latter are perhaps best used before preobservation con- 
ferences, though ongoing self-analysis through tapes or student 
feedback can be very useful. 

The feedback portion of theevaluation is critical, too. Evaluators 
should assume a positive tone, ask thoughtful questions, give 
plenty of time for responses, and let the teachers draw their own 
conclusions whenever possible. 



Th« 8«tt of EKIC on Educational Management 
it a product of tha 
ERIC Claarin^houta on Educational Mana^ament 
Offica of Edccational 
Rataarch ai|^ Improvanant 
U.S. Dapartment of Education 
Tha Educational Rasourcat Infornation Canter (Eric) 
la a national information ayatem operated by the 
Office of Educational Reaearch and iMprovement, U.S. 
Department of Education* ERIC aervea educators by 
diaaeminating reaearch reaulta and other reaource 
intoriMtion that can be uaed in developino more 
•tfective educational pro^rama. The ERIC Clearin^houae 
on Educational Mana9ement, one of aeveral auch unite in the 
•yatem, vaa eatabliahed at the Univeralty of Oregon in 1966. 
The Clearin9houae and ita cotrpanion units process reaearch 
reports and Journal articles for announcement in CRiC's 
index and abstract bulletins. 

Besides processing documen^is and journal articles, the 
Clearinghouse prepares bibliographies, literature revievs^ 
M>nographs» and other interpretive research studies on 
topics in its educational area. 



TAis puDiication vas praparetf with Cunding item the Office 
of Educational Research and Is^rovaeent under contract no. 
400-B6-0003. Prior to publication^ the manuscript vas 
submitted to the National Association of Secondary School 
Principals (KASSP) for critical review and determination of 
professional coii4>etence. The publication has met such 
standards. Points of viev or opinions^ however, do not 
necessarily represent the positions or policies of OERI, 
KA88P, or the Clearinghouse. 



